AD-A189  72  1  DRT  DOCUMENTATION  PAGE 


|  lb  RESTRICTIVE  MARKINGS 


it  SECURITY  CLASSIFICATION  AUTHORITY 
2b  DECLASSIFICATION  /  DOWNGRADING  SCHEDULE 
4  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


3  DISTRIBUTION/ AVAILABILITY  OF  REPORT 

Approved  forpuMlt*  j 

distribution  unlimited. 

5  MONITORIN<i^G4^^TIO!^E^3RT 


64.  NAME  OF  PERFORMING  ORGANIZATION  6b  OFFICE  SYMBOL  7a  NAME  OF  MONITORING  ORGANIZATION 

(If  applicable) 

f  AFOSR/NM 

University  of  Alberta _ 


6c.  AOORESS  (Oty,  State,  and  ZIP  Code) 

Edmonton,  Alberta,  Canada  T6G  2G1 


7b  AFOSR5/^^'  5Utr  Jna  /IPCodr> 

Bldg  410 

Bolling  APB  DC  20332-644* 


8a.  NAME  OF  FUNDING  /  SPONSORING 
ORGANIZATION 

AFOSR _ 

8c.  ADDRESS  (C/ty.  State,  and  ZIP  Code) 
AFOSR/NM 
Bldg  410 


8b  OFFICE  SYMBOL  9  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable) 

ra  AFOSR-86-0332 


10  SOURCE  OF  funding  NUMBERS 

PROGRAM  I  PROJECT  T 

ELEMENT  NO  NO  I 

61102F  2304 


I  WORK  UNIT 
ACCESSION  NO 


11  TITLE  (Include  Security  Classification) 

Martingale  Representation  and  the  Malliavin  Calculus 

12  PERSONAL  AUTHOR(S) 

Robert  J.  Elliott  &  Michael  Kohlmann _ _ 

13a.  type  of  report  ll3b  TIME  COVERED  14  DATE  OF  REPORT  (Year,  Monti 

Reprint _  from  9/30/86  ro9/30/87  1987 

16  supplementary  notation 


ELECTED 
JAN  0  7 1988  ^  S 

f  lis  PAGE  count  S-dLdr 


11.  1987 


17 

COSATI  COOES  j 

FIELD 

GROUP 

SU8-GROUP 

18  SUBJECT  TERMS  {Continue  on  reverse  if  necessary  and  identify  by  block  number) 


19  ABSTRACT  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 

The  focus  of  this  research  is  the  filtering  jump  processes.  To  investigate  the 
filtering  of  manifold-valued  processes,  their  approximation  by  random  «alks  and  Marko 
ch^  was  studied.  The  object  was  to  approximate  a  signa  process  by  a  frnr testate 
jump  process  for  which  a  finite-dimensional  filter  is  available  for  the 

published  during  the  past  year,  including  ™e  *  rtiallv  observed  stochastic 

prediction,  filtering  and  smoothing  problems  and  The  partia  y 

minimum  principle". 


20  OISTRI8UTION/ availability  of  A8STRACT  21  ABSTRACT  SECURITY  CLASSIFICATION 

□  UNCLASSIFIEQ/UNLIMITSO  □  SAME  AS  RPT  □  QriQ  USERS 
22a.  NAME  OF  RESPONSIBLE  INDIVIDUAL  22b  TELEPHONE  (Include  Area  Code)  22c  OFFICE  SYMBOL 

^ ^ —  ^ ^ ^ jN  | 

DO  FORM  1473.  34  MAR  83  apr  ea.t  on -T.ay  0e  usea  until  exhausted.  security  classification  of  -->s 

All  otfe?  eaitions  are  ootoiete  ' 


1%  vq  Ilf  1L~ . 


AFOSR.-nt.  8  7-1845 


Martingale  Representation  and  the 
Malliavin  Calculus 


Robert  J.  Elliott  Michael  Kohlmann 

University  of  Alberta  Universitat  Konstanz 

Edmonton,  Alberta  D7750  Konstanz 

Canada  F.R.  Germany 


\ 


AooesBion  For 

NT IS  GRA&I  ~ 
DTIC  TAB 
Itaannoui'.ci".* 
Jus  Ilf  1 


Martingale  Representation  and  the 
Malliavin  Calculus 


by 

Robert  J.  Elliott^1) 
Department  of  Statistics 
and  Applied  Probability 
University  of  Alberta 
Edmonton,  Alberta 
Canada  T6G  2G1 
and 

Michael  Kohlmann^2) 

Fakultat  fur  Wirtschaftswissenschaften 
and  Statistik 
Universitat  Konstanz 
D7750  Konstanz 
F.R.  Germany 


ACKNOWLEDGEMENT.  (^Research  partially  supported  by  the  Natural  Sciences 
and  Engineering  Research  Council  of  Canada  under  grant  A-7964  and  the  Air  Force  Office 
of  Scientific  Research,  United  States  Air  Force,  under  grant  AFOSR-86-0332. 

Research  partially  supported  by  the  Natural  Sciences  and  Engineering  Research 
Council  of  Canada  under  grant  A-7964. 


1.  INTRODUCTION. 

Using  the  theory  of  stochastic  flows  the  integrand  in  a  stochastic  integral  is  identified. 
After  some  rearrangement  this  integrand  is  itself  written  in  terms  of  a  martingale  which 
can  be  expressed  as  a  stochastic  integral,  and  by  recursively  repeating  the  representation  a 
homogeneous  chaos  expansion  is  obtained.  Using  the  stochastic  integral  representation  an 

integration  by  parts  formula  is  then  derived.  If  the  inverse  of  the  Malliavin  matrix  M  be- 

•  r  *  .  •'  -i  6 

longs  to  all  the  spaces  IP  (fl)  we  show  a  random  variable  has  a  smooth  density.  The  difficult 
questions  concerning  the  relationship  between  Hormander’s  conditions  on  the  coefficient 

i- 

vector  fields  and  the  integrability  of  M~  1  are  not  discussed,  but,  at  least  for  Markov  flows, 
the  discussion  below  appears  to  be  an  elementary  treatment  of  some  ideas  of  the  Malliavin 
calculus.  This  paper  was  presented  at  the  Workshop  on  Diffusion  Approximations  held 
at  the  International  Institute  for  Applied  Systems  Analysis,  Laxenburg,  Austria,  in  July 
1987.  A  fuller  treatment  of  the  ideas  given  here  can  be  found  in  [l]. 

2.  DYNAMICS. 

Consider  a  stochastic  differential  system 

dxt  =  XQ(t,xt)dt  +  Xi(t,xt)dw\.  (2.1) 

Here  x  €  Rd ,  0  <  t  <  T  and  w  =  (iul , . . . ,  wm )  is  an  m-dimensional  Brownian  motion  on 
(fl ,F,P).  We  shall  suppose  the  coefficient  vector  fields  X  are  smooth  and  have  bounded 
derivatives  of  all  orders. 

From  results  in  [2j,  for  example,  it  is  known  that  for  0  <  s  <  t  <  T  and  xt  £  Rd  there 
is  a  unique  solution  £<t(z#)  of  (2.1)  with  £#t,(z,)  =  x,.  Furthermore,  there  is  a  version 
of  this  solution  which,  almost  surely,  is  smooth  in  i,  6  if1. 

If  z0  6  Rd  and  z  =  £o,t(zo)>  because  the  solutions  of  (2.1)  are  unique: 


£o,r(xo)  -  it,T  ((o,i  (xo )) 


* 


9  £ 

Write  Dt  t  =  for  the  Jacobian  of  the  map  x  — *  t(x).  Then,  differentiating  (2.2) 


d  Z 


Dq  t  —  DftT  D ot(. 


Again,  from  [2]  we  know  that  D  satisfies  the  equation 


=  it  D-',dt  +  it  D-*iw' 


(2.3) 


with  Dtt  =  7,  the  d  x  d  identity  matrix. 

Consider  the  matrix  function  Vl  t  defined  by  the  stochastic  differential  equation 


3X0  .  ..  3X. 

dV»,t  ~  ~V*,t  ~Q£ 


^  "dt  ^ 


(2.4) 


with  V4i,  =  I.  Here 


*0  =  ^  -  5  E 

Then,  see  [2j,  d(Vt  tD,  t)  -  0  so 


a  =  l 


dXj 


i 


)*i- 


v,.t  =  D~! 


3.  MARTINGALE  REPRESENTATION. 

Suppose  x0  €  Rd  is  given.  Consider  a  smooth,  bounded  function  c  on  Rd  and  the 
random  variable  c(£0  j  (xo))-  Write  {Ft}  for  the  right  continuous,  complete  filtration 
generated  by  Ft  =  o{wt  :  s  <  t}.  Because  x0  is  known  o{xt  :  s  <  t}  C  Ft  and  the  process 
(xt,tot)  is  Markov.  Consider  the  martingale 


Mt  =£[ctfo.r(*o))  \Ft\. 

Then  by  the  martingale  representation  result 

Af,  =  M0  +  f  li{s)dwxt 
Jo 


(3.1) 


£ 

.'M 


& 


a 


Si 


ft 


V 

V. 


■  ■ji 


-VJ 


ft 


V<1 


Differentiating  inside  the  expectation 


3V_ 

dx 


If, I 

by  the  chain  rule, 


So 


and 


Tt(0  =  £M£o,r(*o))£>o,r  I 


(3.3) 


m,  =  £|«(<o,t(*o))]  +  f  i  (3.4) 

Jo 

REMARKS  3.1.  Note  the  term  E[e^  (£o,r  (xo))^o,T  |  ]  is  itself  a  martingale.  If 

the  representation  is  written  down  at  t  =  T 

Mt  —  c(£o,r  (xo))  =  ^'[c(^o,r  (xo))l  +  f  E\ci  (£o,r  dw\.  (3.5) 

Jo 

Also,  the  representation  (3.4)  holds  for  vector  (or  matrix)  functions  c. 

If  we  take  e(£)  =  £  to  be  the  identity  map  on  Rd  (3.5)  gives 

£o,r  (xo)  =  £[£o,r  (zo)!  +  f  E[Do,t  I  ^*\^o,» 

Jo 

Also,  if  we  consider  (3.5)  for  a  second  smooth  bounded  function  g  and  take  the  expected 
value  of  the  product  of  each  side,  we  see: 


E\cUo,t  (xo))0(£o,r(xo))]  =  £(«((o,r(xo))|£|ffUo,r(xo))] 

+  E\jr  f  e\c^dot  I  f,|d-;x,x;d;-.‘%(d0,t 

,.,J"  (3.6) 

DEFINITION  3.2.  The  MaHiavin  matrix  for  the  system  (2.1)  is 

m 

M>.<  =  E  ( /  D;‘Mu)x;{u)D::,ldu). 

•  =  1  9 

Note  something  resembling  M0  l  occurs  in  (3.6). 


4.  HOMOGENEOUS  CHAOS  EXPANSIONS. 

Consider  an  enlarged  system  with  components  =  (£,£>).  The  stochastic  differ¬ 
ential  equation  for  is,  therefore,  the  system  (2.1)  and  (2.3).  The  coefficients  in  (2.3) 
are  no  longer  bounded,  but  following  Norris  [4]  a  sequence  of  ‘triangular’  systems  can  be 
considered  and  the  results  on  stochastic  flows  still  hold.  We  can,  therefore,  consider  the 
Jacobian  D W  of  the  system  and  a  system  £(2)  =  (f^1), .E^1)).  Proceeding  in  this 
way  is  a  system  with  components  (^R-1^,D('l_1^).  Write 

<<•>  =  |  z>0,T 


cW  =  D<" 


etc. 


3*0)  °-T 

Equation  (3.4)  can  then  be  written 

'Uo.tM)  =  £M6>,r(*b))l  +  /  C|c(l)  I  F.}D-\X,dw:.  (4.1) 

Jo 

However,  J3[e0)(*^)  |  Fa  |  can  be  represented,  as  in  Section  3,  as  a  stochastic  integral 

Here,  X^  is  the  coefficient  vector  field  of  w*  in  the  system  defining  *0).  Substituting  in 

(4.1) 

«(€o,T(*b))  =  E\c\  +  E[cW)  \T  D~\XM 

Jo 

+ r  ( r  b[«(2)  i  1  *  (*.  )  co,i  . 

JO  x  Jo  J  '  (4  2) 

Now  E[c(2)  |  F,,)  can  be  expressed  as  a  stochastic  integral  and  the  result  substituted  in 

(4.2) .  Proceeding  in  this  way  we  obtain  the  homogeneous  chaos  expansion  of  the  random 
variable  c(Co,r  (^o))-  The  repeated  stochastic  integrals  do  not  involve  c  but  only  the 
Jacobians  /}(*)  and  coefficients  X(*K 


6 


5.  INTEGRATION  BY  PARTS. 


Lemma  5.1.  Suppose  u  =  (ux , . . . ,  um )  is  a  square  integrable  predictable  process.  Then 

E[c{to,TM)  f  ^idw\\  =  ]^.E[ef(£o,r  (*<>)) A>, r  Jq  Do,sXi(s)uds)ds  - 

^  t=  1 

PROOF.  Consider  the  representation  (3.5)  for  c(£0it(xo)).  Multiply  by  u {dw\ 
and,  using  Fubini’s  theorem,  take  the  expectation. 


COROLLARY  5.2.  Takeu-(s)  =  (D~ ]  X,(s))* .  Then 

£M&,r(*o))  rW^W,W.l  =  Editor  M)D0,TM0iT\.  (5.1) 

Jo 

REMARKS  5.3.  Consider  a  product  function  h(^o  r(i0))  =  c(£or  (i0))<?(6o,t  (xo)) 
and  apply  Corollary  5.2  to  h.  Then 

£[(<*)  («o,r(*o))  fT  (D;\Xiydw\]  =  E\[c(g  +  cg()D0tTMOJ).  (5.2) 

Jo 

We  would  like  to  take  g  =  Af“^  D~  ^  in  (5.2)  so  that  we  can  obtain  a  bound  for  .  This 
can  be  done  by  considering,  again  following  Norris  [4],  a  hierarchy  of  stochastic  systems 
similar  to,  but  different  from,  those  introduced  in  Section  4. 

This  time  write  (w,s,t,z)  =  £,f*(z)  for  the  flow  defined  by  (2.1)  and  D^J (z)  = 
Dt  t(x)  for  its  Jacobian.  r[°^  =  ff  (D~l Xt(u) )  * dw'u  and  M^°J  =  M,  t  is  the  Malliavin 
matrix  defined  in  (3.2).  Note  that  Mt  t  can  be  considered  as  the  predictable  quadratic 
variation  of  the  tensor  product  of  R with  its  adjoint  that  is  =  {R^  ®  R^ 

Now  consider  an  enlarged  system  <f> ^  with  components 

^(>)  =  (^(°),  £>(°),  R(°),  M<°)). 


The  results  of  Norris  [4]  on  stochastic  flows  allow  us  to  discuss  the  Jacobian  D of 
Suppose  is  the  coefficient  of  w*  in  the  system  describing  ,  and  write 

R'.'J  = 


m'1,1 


Then  define 


<t>W  =  Dll\  r(1\  M^) 

and  inductively,  ^n+ ^  =  [4>^nK  D^n\  R^n\  M^).  Write  Vn  for  the  gradient  operator 
in  the  components  of  The  following  result  is  established  like  equation  (5.2)  by 

considering  the  martingale  representation  (3.5)  of  the  produce  eg. 

THEOREM  5.4.  Suppose  c  is  a  bounded  C°°  scalar  function  on  Rd  with  bounded  deriva¬ 
tives.  Let  g  be  a  C°°  possibly  vector,  or  matrix,  valued  function  on  the  state  space  of  <j>(n) 
such  that  g(<p(n)  (0,T,x0))  and  V ng(<f>^  (0,T,  x0))  are  both  in  some  U’{ Q).  Then 

B(c(^°>(o,r))!i(*<")(o,r)) «  1 

=  B[(voC)(^0)(o,r))9(*(">(o.r))B0.TM0iT] 

+  £[c(*<°>  (0,T))(V„j)(#<“>(0,  T))D$  M$|.  (5.3) 

COROLLARY  5.5.  GronwalTs  inequality  shows  that  D~ 1  is  in  all  the  1/  (fl)  spaces,  so 
if  M~*  is  in  some  L?  (0)  taking  g(<f>(1)  (0,T))  =  in  (5.3) 

E\c(  (£o,T  (xo))]  =  ^'[c(£o,T  (xo))Mo,T  DotT 

-  *we„.r  (*o))(v,  »)(flo.r .  m0,t  )D{0'1  M0<y  |. 

Because  c  is  bounded  we,  therefore,  have  the  following  result: 

THEOREM  5.6.  Suppose  £o,r(xo)  15  the  solution  of  (2.1)  and  c  is  any  smooth  bounded 
function  with  bounded  derivatives.  Then  if  is  in  some  £/  (fl) 

|£(c((£o,r(xo))l!  <  K  sup  |c(*)|.  (5.4) 

z£Rd 

REMARKS  5.6.  It  is  well  known  that  (4.3)  implies  the  random  variable  £0  -p  (x0)  has 
a  density  d(x).  To  show  the  density  d  is  smooth  we  wish  to  establish  inequalities  of  the 


E  3jdrtfo.T(xo))]|  <  K  sup  \e{x)\. 


da  dai  dQ 2  3°* 

~  aef7  aef7  “*  dij7* 

An  argument  from  Fourier  analysis,  (see  [4]),  shows  that  if  (5.5)  is  true  for  all  a  with 

|a|  =  aj  H - f  ad  <  n  where  n  >  d.  +  1  then  the  random  variable  £0  T  (i0)  has  a  density 

d(x)  which  is  in  Cn~d~ 1  (Rd). 

Apply  Corollary  5.5  to  rather  than  c  so 

(zo))l  =  E\c^(^oT(x0))M0^  D0j  ® 

-  £|*< (&,r  (*o))(?i »)(M>.r , M0,T)D^l  M^). 

'  ’  (5.6) 

Consider  the  two  terms  on  the  right  of  (5.6)  and  write  M  =  M0  T ,  D  —  D0  T ,  etc.  Let 

gi[<f>{1])  =M~1D~1  ®  RM~1D~1 
and  g2{<f>{2))  =  (^ig)(D,M)D^M^ D'1 . 

Applying  Theorem  5.4  to  and  cg2: 

E[cUo,t  M)9i  (4>{l))  ®R}  =  E\c{  (e0,T  (zo))A*- 1  D~  1  ®  R] 

+  E\c^0iT(x0))(V2gi){^)D^M^ 


E\c(t0,TM)92(<t>{2))  ®R}  =  E[c(U0tT(x0))(Vl9){D,M)D^M^\ 

+  E[c(t0}T{x0))(V3g2)(4>W)DWM(% 

(5.8) 

Using  (5.7)  and  (5.8)  the  terms  on  the  right  of  (5.6)  can  be  replaced  by  terms  involving  c. 
This  procedure  can  be  iterated  using  Theorem  5.4  and  the  following  result  established: 


vv 


THEOREM  5.7.  Suppose  M  1  is  in  ail  spaces  1/(11),  1  <  p  <  oo.  Then  the  random 
variable  a  smooth  density. 

The  remaining  questions  concern  the  existence  and  integrability  properties  of  . 
These  have  been  carefully  studied;  see  Ikeda  and  Watanabe  [2],  or  Norris  [4],  for  example. 
In  fact  Mqt  is  in  I/(d)  for  all  p,  1  <  p  <  oo,  if  the  following  condition  of  Hormander  is 
satisfied: 

CONDITION  5.8.  The  vector  space  V(x0)  generated  by  the  coefficient  vector  fields 
Xi , . . . ,  Xm  and  the  brackets  [Xit  ATy],  0  <  i,j  <  m,  [Xt-,  [X; ,  Xk  ]],  0  <  i,j,  k  <  m  etc., 
evaluated  at  x0  €  R1 ,  is  the  whole  of  Rd . 
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